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September 15, 1970 



Miss Jean L. Connor, Director 
Division of Library Development 
The New York State Library 
Albany, New York 12224 



Dear Miss Connor: 



We are pleased to submit this study of unfilled interlibrary loan 
requests in the New York State Interlibrary Loan network (NYSILL) . Our 
report describes the library reference problems which were associated 
with these requests, and suggests probable reasons for the system 1 s in« 
ability to fill these items. The findings of the study again demonstrate 
the immense potential of NYSILL as a reference and research resource for 
New York, Over 80 percent of these requests were found to be held by 
one or more libraries in the system. 

The text of the report summarizes the methods and data resources of 
the study, and provides an overview of our findings with respect to the 
complete set of unfilled requests. The bulk of this study, however, is 
in the case studies which have been prepared for each item in the sample. 
These are assembled together in the appendix, and include a reproduction 
of the original TWX message for each request, an identif ication of errors 
in citations and of problems of verification, original referral histories 
in NYSILL and actual system holdings, and notes on special factors which 
may have influenced cur summary judgements about particular requests. We 
feel that careful study of this appendix may assist local librarians in 
achieving a better understanding of the difficulties in processing inter- 
library loan requests in NYSILL, and in improving the quality of the 
citations submitted to the network. The appendix may also be a useful 
tool for more genr-.ral reference instruction in library science. 

Our introductory remarks have been prepared with the intention of 
maintaining continuity with previous studies of NYS.CLL. A brief review 
of the system is included to assist readers who may not be familiar with 
the network, and recent developments in the system are noted so that other 
readers may be brought up to date. 

This project owes a great deal to those many reference librarians, 
outside NYSILL as well as within it, who helped us obtain the information 
used in this report. "Telling me about a request like this," one colleague 
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told us, "is like offering a bone to a dog." It may well be that unraveling 
incomplete or inaccurate reference citations is an enjoyable challenge for 
many professionals in library science — it was certainly so for us — but this 
does not diminish our appreciation in the least. 

Other important acknowledgements are due to Sarah Katharine Thomson, 
librarian of Bergen Community College in Paramus, New Jersey and author of two 
recent ALA publications on interlibrary loan practices. This project has bene- 
fited greatly from Dr. Thomson's expert guidance. Janet Weiss, now returned to 
her studies at Yale University, assisted in all phases of the study, searched 
the sample of unfilled requests at some 15 different libraries in New York, and 
prepared much of the material in the appendix. Mary Felix, librarian for the 
interlibrary loan unit at the New York State Library, provided from her files 
the original TWX messages which form such an important part of the case studies. 
And Mr. John Baker, executive assistant at the New York Public Library Research 
Libraries, made it possible for us to use the verification , facilities and the 
official catalogs at the NYPL. 

If we can assist in the interpretation or dissemination of the con- 
tents of this report, please call on us. 



Yours truly 




Richard A. Ellis 



NELSON ASSOCIATES, INC.. 
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ABSTRACT OF FINDINGS AND RECOMMENDATIONS. 



This is a study of 140 unfilled kterlibrary loan requests sent to the New York 
State Interlibrary Loan network (NYSILL) during October and November, 1968. Detailed 
information on each case in the study is ‘pn^kled in an appendix to the report. An analy- 
sis of all of these data generated the findings and recommendations summarized below. 

FINDINGS: 

(1) The unfilled requests do not differ markedly from filled requests 
referred to NYSILL lending libraries. Foreign language citations 
are somewhat more common in this sample than would ordinarily 
be the case for NYSILL requests. Other than this, however, the 
requests mirror the characteristics of all NfSILL loans in their 
patron status, originating library type, age, level, and subject matte± 

(see p;iges 9-15). 

(2) The quality of citations for the unfilled requests was rather good, 
compared to that found in other interloan investigations. Over 
85 percent of the citations were passable; over a third were per- 
fect. Inclusion of a verification statement with the citation is no 
guarantee that the information given is accurate, however (see pages 
15-19). 

(3) The overwhelming majority of the requests— almost 85 percent— 
were for materials owned by one or more NYSILL lending librar- 
ies. However, ownership does no 1 : always imply a possible loan. 

About a fifth of the items held would probably not have been 
lent, because of heavy circulation, refusals to lend, or delays in 
technical processing of newly acquired materials. Of the requests 
for items not held by NYSILL lending libraries, a quarter would 
not have been available at any library (due to requests for mater- 
ials not actually published at the time, requests for articles not 
in the serials given, etc.); the rest were verified as held outside 
the system (see pages 19-22). 

(4) Ninety-four of the 140 requests were both held and judged to 
have been available for loan at the time of the original referral. 

Of these, correction of searching and routing errors would pro- 
bably have resulted in filling about 56 percent. The most fre- 
quent problem was premature cancellation of a request; the 
second most frequent was routing to inappropriate libraries; the 
third most frequent was missearching. Attention is called to the 
phenomenon of the “dark horse” request, the one which was 
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not filled even though it either received error-free processing 
or experienced errors which, even if they had not occured, 
would have made no difference in the outcome (see pages 
23-32). 

RECOMMENDATIONS : 

(1) NYSILL can still make worthwhile improvements both in the 
general quality of citations for requests submitted to the sys- 
tem, and in the time consumed in searching requests at lending 
libraries, by engaging in intensive training in interlibrary loan 
procedures. Staff at originating libraries need to be familiar 
with the NYSILL manual, which explains the specific require- 
ments of the system. Even more important, they need to 
know and understand the general practices of interlibrary loan 
work, as explained in the ALA Inlerlibrary Loan l*rocedure 
Manual. A third useful tool in this training might be the case 
study material contained in the present report (see pages 33-34). 

(2) A review of the requests for materials not owned by any of 
the libraries contracted to NYSILL suggests that additional 
resource institutions are not needed at this time. Of course, 
such resources might be justified to enable NYSILL to handle 
requests which were not entering the system at all in 1968 
(see pages 34-35). 

(3) Steps could be taken to reduce the proportion of items which 
are owned but not lendable. These include: 

(a) creation of a collection of circulating 
reference books at the State Library; 
and 

(b) creation of backup subject library desig- 
nations for all fields assigned to Cornell 
University, so that the system will be 
able to fill requests for recent materials 
in those subjects (see page 35). 

(4) Other steps can be taken to improve the NYSILL system’s ability 
to make maximal use of its resources. These include: 

(a) modifying the state’s “in circulation” rule 
to permit cancellation of requests only if 
they receive at least two such reports after 
referral beyond the State Library; 
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(b) use of the new New York State Union List < 
of Serials; 

(c) further modifications cf the subject assign- 
ments in NYSILL, to specify referrals for 
materials in business and for government 
documents; 

(d) the use, as planned, of the New York Public 
Library Research Libraries as a “library of 
last resort”; and 

(e) more carefully stated and executed routing 
procedures, including 

(f) guaranteeing at least two referrals for any 
NYSILL request sent beyond the State 
Library. 

Application of suggestions (e) and (f), above, will be assisted by 
the creation, if this can be done, of some simple guideline for 
judging the scholarly level of a request. Until a better one can 
be found, the rule used in this study provides a workable al- 
ternative: if the request seems clearly to fall into one of 'he 
subject categories listed by NYSILL in its division of responsi- 
bilities among lending institutions, it is likely to be of at least 
“medium” level, if not more. 

If all of remedies listed above bad been in effect in the Fall of 
1968, it is estimated that the filling rate for the NYSILL referral 
network would have been improved from 57 to 73 percent, 
causing a rise in overall success rates for the system as a whole 
from 65 to 70 percent (see pages 35-37). 
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Is INTRODUCTION 






It is axiomatic in modern library circles that no single 
institution can possibly acquire all of the materials which its users 
might need. For most libraries, the best strategy is to collect the 
items which will satisfy the more predictable demands of local patrons, 
relying on other larger or more specialized places for the occasional 
atypical request. Such a policy is not a substitute for collection 
building, 1 but rather a recognition that not even the finest research 
library can hope to encompass the full range of current scholarly and 
technical literature. 

The usual mechanism for tapping the resources of another 
library is the interlibrary loan request, either in its traditional 
mailed variety, using standardized forms developed by the American 
Library Association (ALA) , or through any of several new kinds of 
interlibrary networks linked by telephone, telefacsimile systems, 
teletype or Telex installations, or even direct, on-line communica- 
tion between computers. In processing interlitrary loans, the most 
common shorthand term for advising a requesting library that one does 
not possess desired material is "NIL" — Not In Library. This is a 
study of such requests. Strictly speaking, our attention goes beyond 
NIL’s to include items unavailable because of heavy use ("NOS," or 
Not On Shelf), materials which libraries are unwilling to lend ("WNS," 
or Will Not Send) , or any other condition which, from the perspective 
of the patron, amounts to failure. In addition, this study deals not 
with simple requests from one library to another, but with a sample 
of unfilled requests which were directed to a whole system of libraries: 
the New York State Interlibrary Loan network, or NYSILL. 

The NYSILL Network 

Very detailed descriptions of NYSILL and its operations are 
available elsewhere. 2 Here our attention is limited to a brief over- 
view, to provide a setting for those unacquainted with NYSILL and to 
bring others up to date. Service in NYSILL was begun in March, 1967 



Reliance on other libraries for "core collection" materials is often 
considered a serious abuse of interlibrary loan practices. See NYSILL 
Evaluation: Phase III — 1969 (Albany: Division of Library Development, 

New York State Education Department, 1970), pp. 43-44. On the other hand, 
the growth of both patron demands and scholarly literatures is so swift 
that many institutions may feel justified in requesting titles which might 
not have been, by past standards, of an appropriate level for interlibrary loan. 

2 See NYSILL: New York State Interlibrary Loan Network (Albany: Division 
of Library Development, New York State Education Department, 1970 [revised]); 
and R. A. Ellis, Nina Root, and John Eller, Interlibrary Loan in New York 
State (New York: Nelson Associates, 1969). 
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when the New York State Library established a network of eleven resource 
libraries to serve the information needs of the entire state. The State 
Library acted as the major statewide resource and as the switching center 
for the system, drawing on the collections of other participants in the 
network whenever it could not provide requested materials. Since 1967, 
one library has been dropped from the network and two others added. The 
present participants are the public libraries of Buffalo and Erie County, 
Rochester, and Brooklyn (with linkages through Brooklyn to the New York 
Public Library Circulation Libraries and the Queens Borough Public Library); 
several major research libraries (the New York Public Library Research 
Libraries, and the libraries of Cornell, Columbia, and New York Univer- ' 
sities) , and several specialized research libraries (those of the New York 
Academy of Medicine, the Engineering Societies, the American Museum of Nat- 
ural History, Teachers College, and Union Theological Seminary). 



Requests to NYSILL originate at public, academic, and special 
libraries throughout the state. The exact total number of libraries which 
have made use of the system is unknown ; in any event, the number is a large 
one. The 1968 evaluation of the program, based on a ten percent sample of 
requests for a single three-month period, tabulated use by wore than 400 in- 
stitutions. ^ Requests from public and special libraries are generally routed 
through regional centers, either local public library systems or larger 
regional interlibrary loan networks, before TWX transmittal to the State Li- 
brary at Albany; requests from the larger universities typically bypass 
these regional units. The number of items eventually searched at the New 
York State Library is now well over 100,000 requests per annum. 

Ever since NYSILL began operations, the State Library has been 
able to fill between 44 and 47 percent of the requests it received. 1 * Of 
the remainder, a steadily increasing portion has been referred to one 
or more of the libraries in the NYSILL network, in 1969, the proportion 
of referrals beyond the State Library reached 36 percent, or well over 
half of all loan requests received but not filled at Albany. Not all 
items received by the State Library are eligible for referral into the 
network, of course. Examples of types of material which Albany would 
itself loan but which it will not refer to the network include fiction, 
children's literature, textbooks, recreational materials, and self-help 
books. Occasionally even these kinds of requests will also be referred, 
as will be seen when the data for this study is reviewed. 

The referral libraries fill about 40 percent of the requests 
which they receive; by way of contrast, about 64 percent of the traffic 
is mailed interlibrary loan forms between academic libraries results in 
filled loans. 5 The lower success rate for NYSILL referral libraries is 
a direct result of the screening effect of prior searches at the State 
Library, which is itself a formidable research library with a collection 




3 Interlibrary Loan in New York State , op. cit.,, p. 98. 

4 NYSILL Evaluation: Phase III — 1969, op. cit., p. 15. 

5 Sarah Katharine Thomson, Interlibrary Loan Involving Academia Libraries 

(Chicago: American Library Association, 1970), ACRL Monograph No. 32 
Page 64 . ’ 
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of well over 4,000,000 volumes. Since requests may be referred more than 
once, as a group the participating libraries fill almost 60 percent of the 
requests routed beyond the State Library. When these filled items are added 
to those which have been provided by Albany, the filling rate for NYSILL as 
a whole reaches 65 percent. 

The NYSILL system includes provisions for reimbursing the parti- 
cipating libraries for the requests which they handle. Any library filling 
a request is paid $2.00 to cover its handling and mailing expenses. In 
addition, the public libraries are paid $1.00 to search a request, whether 
it is filled or not, and the university and special libraries receive 
$2.50 for the same service. 6 Since a request referred three times can cost 
the state between $3.00 and $7,50 just for searches, and since success 
rates for third (or later) referrals have been very low, the number of 
referrals has tended to be limited to two in order to keep the service within 
reasonable limits of cost-effectiveness. Such factors are important in 
assessing the judgments offered in this study about system handling of 
specific requests. 

In oxaer to insure a reasonable probability of filling loans with one 
or two referrals, the university and special libraries within NYSILL have 
been designated with responsibilities for specified subject fields. Thus 
Teachers College has acted as the NYSILL subject center for materials in 
education. These subject guidelines have recently been extensively revised, 
and as a result suggested routings now exist which were not in use in 
the Fall of 1968, when the requests in this study entered the system. 

Other modifications or special characteristics of NYSILL which affect the 
conclusions of this report will be taken up below in the material on 
study methodology. 

As an interlibrary network, NYSILL exhibits a number of other features 
of great potential interest to the library profession. It includes a major 
pilot test of the feasibility of computer assistance In managing such 
systems. It is an excellent test of the practicality of combined public 
and academic library service. Its cost structure, and the dramatic reduc- 
tions in unit costs which have been experienced since 1967, illustrate 
some of the financial considerations which must be faced by designers of 
large-scale interlibrary networks. All of these topics are outside the scope 
of the present study, and the reader who wishes to obtain more information 
is urged to consult the references given above. 

The Study Sample 

The 1968 evaluation of NYSILL was based on a ten percent systematic 
selection (every tenth case) of all requests handled by the network during 
the period October-December , 1968, These cases may be treated as a pure 
random sample, since inspection of the data showed that no particular 
ordering within the groups of ten occured. 7 Data gathered for the 1968 



6 An analysis of the equity of these fees will be found in Cynthia Rice, 

R. A. Ellis, and Nina Root, An Evaluation of the New York State Library's 
NYSILL Pilot Program (New York; Nelson Associates, 1968), pp. 122-150. 

Efyc 7 See Leslie K ish, Survey Sampling (New York: John Wiley, 1967), pp. 113-127. 



